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Abstract — In this paper, we study the asymptotic properties of 
distributed consensus algorithms over switching directed random 
networks. More specifically, we focus on consensus algorithms 
over independent and identically distributed, directed Erdos- 
Renyi random graphs, where each agent can communicate with 
any other agent with some exogenously specified probability p. 
While it is well-known that consensus algorithms over Erdos- 
Renyi random networks result in an asymptotic agreement over 
the network, an analytical characterization of the distribution 
of the asymptotic consensus value is still an open question. In 
this paper, we provide closed-form expressions for the mean and 
variance of the asymptotic random consensus value, in terms of 
the size of the network and the probability of communication p. 
We also provide numerical simulations that illustrate our results. 



I. Introduction 

Due to their wide range of applications, distributed con- 
sensus algorithms have attracted a significant amount of at- 
tention in the past few years. Besides their applications in 
distributed and parallel computation [1], distributed control 
[2], and robotics [3], they have also been used as models 
of opinion dynamics and belief formation in social networks 
[4], [5]. The central focus in this vast body of literature is 
to study whether a group of agents in a network, with local 
communication capabilities can reach a global agreement, 
using simple, deterministic information exchange protocols^ 

More recently, there has also been some interest in under- 
standing the behavior of consensus algorithms in random set- 
tings [7]-[12]. The randomness can be either due to the choice 
of a randomized network communication protocol or simply 
caused by the potential unpredictability of the environment 
in which the distributed consensus algorithm is implemented 
[13]. It is recently shown that consensus algorithms over i.i.d. 
random networks lead to a global agreement on a possibly ran- 
dom value, as long as the network is connected in expectation 
[10]. 

While different aspects of consensus algorithms over ran- 
dom switching networks, such as conditions for convergence 
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[7]— [10] and the speed of convergence [13], have been widely 
studied, a characterization of the distribution of the asymptotic 
consensus value has attracted little attention. Two notable 
exceptions are Boyd et al. [14], who study the asymptotic 
behavior of the random consensus value in the special case of 
symmetric networks, and Tahbaz-Salehi and Jadbabaie [15], 
who compute the mean and variance of the consensus value 
for general i.i.d. graph processes. Nevertheless, a complete 
characterization of the distribution of the asymptotic value for 
general asymmetric random consensus algorithms remains an 
open problem. 

In this paper, we study asymptotic properties of consensus 
algorithms over a general class of switching, directed random 
graphs. More specifically, we derive closed-form expressions 
for the mean and variance of the asymptotic consensus value, 
when the underlying network evolves according to an i.i.d. 
directed Erdos-Renyi random graph process. In our model, 
at each time period, a directed communication link is estab- 
lished between two agents with some exogenously specified 
probability p. It is well-known that due to the connectivity of 
the expected graph, consensus algorithms over Erdos-Renyi 
random graphs result in asymptotic agreement. However, 
due to the potential asymmetry in pairwise communications 
between different agents, the asymptotic value of consensus 
is not guaranteed to be the average of the initial conditions. 
Instead, agents will asymptotically agree on some random 
value in the convex hull of the initial conditions. Our closed- 
form characterization of the variance provides a quantitative 
measure of how dispersed the random agreement point is 
around the average of the initial conditions in terms of the 
fundamentals of the model, namely, the size of the network 
and the exogenous probability of communication p. 

The rest of the paper is organized as follows. In the 
next section, we describe our model of random consensus 
algorithms. In Section [TTTJ we derive an explicit expression 
for the variance of the limiting consensus value over switching 
directed Erdos-Renyi random graphs in terms of the size of the 
network n and the communication probability p. Section IV 
contains simulations of our results and Section V concludes 
the paper. 

II. Consensus Over Switching Random Graphs 
Consider the discrete-time linear dynamical system 



x(fc) = W fc x(fc-l). 



(1) 



where k 6 {1, 2, . . . } is the discrete time index, x(fc) £ K ra 
is the state vector at time k, and {W^}^! is a sequence of 
stochastic matrices. We interpret (Q~|i as a distributed scheme 
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where a collection of agents, labeled 1 through n, update their 
state values as a convex combination of the state values of their 
neighbors at the previous time step. Given this interpretation, 
Xj(fc) corresponds to the state value of agent i at time k, 
and Wk captures the neighborhood relation between different 
agents at time k: the ij element of Wk is positive only if agent 
i has access to the state of agent j. For the remainder of the 
paper, we assume that the weight matrices Wk are randomly 
generated by an independent and identically distributed matrix 
process. 

We say dynamical system (HJ reaches consensus asymptot- 
ically on some path {Wfe}^. 1; if along that path, there exists 
x* <E K such that Xj(fc) — > x* for all i as k — > oc. We refer 
to x* as the consensus value. It is well-known that for i.i.d. 
random networks dynamical system ([TJ reaches consensus on 
almost all paths if and only if the graph corresponding to the 
communications between agents is connected in expectation. 
More precisely, Tahbaz-Salehi and Jadbabaie [10] show that 
Wk-'-WzWi — ► ld T almost surely — where d is some 
random vector — if and only if the second largest eigenvalue 
modulus of EWk is subunit. Clearly, under such conditions, 
dynamical system (Q]l reaches consensus with probability one 
where the consensus value is a random variable equal to 
x* = d T x(0), where x(0) is the vector of initial conditions. 

A complete characterization of the random consensus value 
x* is an open problem. However, it is possible to compute its 
mean and variance in terms of the first two moments of the 
i.i.d. weight matrix process. In [15], the authors prove that the 
conditional mean of the random consensus value is given by 
the random consensus value are given by 

x(0) T Vl (EW fe ), 



Ex* 



and its conditional variance is equal to 

var(a;*) = [x(0) <g> x(0)] T vec(cov(d)) (2) 
= [x(0) ® x(0)] T vi (E [W k ® W k ]) - [x(0) T Vl (E^ fe )] 2 

where vi (•) denotes the normalized left eigenvector corre- 
sponding to the unit eigenvalue, and ® denotes the Kronecker 
product. In the following, we shall use <J2J to derive an explicit 
expression for the mean and variance of the consensus value 
over a class of switching, directed random graphs.. 

III. Variance Analysis for Finite Erdos-Renyi 
Random Graphs 

A. Directed Erdos-Renyi Random Graphs 

We consider directed graphs G = (V, E) with a fixed set of 
vertices V = {l,...,n} and directed edges. A directed edge 
from vertex i to vertex j is representes as an ordered pair 
with i,j G V. In a directed Erdos-Renyi (ER) graph 
Q (n,p), the existence of a directed edge , with i ^ j, is 
determined randomly and independently of other edges with 
a fixed probability p G [0, 1]. The adjacency matrix A = [a^] 
associated to Q (n,p) is a random matrix with all zeros in the 
diagonal, and off-diagonal elements a,j = 1 with probability 
p, and with probability 1 — p, for i ^ j. Similarly, the out- 
degree matrix can be defined from the adjacency matrix as 
D =diag{di}, where d. t = £\ a>ij- 



In what follows, we associate a sequence of stochastic 
matrices {Wfe}2?_ 1 to a sequence of i.i.d random realizations 
of directed ER graphs {Qk (n,p)} k x _ 1 . To each random graph 
realization, we associate the following stochastic matrix: 



W k = {Dk+I n ) 1 (A k + I n ), 



(3) 



where Ah and Dk are the adjacency and out-degree matrices 
of the graph realization. Notice that adding the identity matrix 
to the adjacency in (O is equivalent to introduce a self-loops 
(an edge that starts and ends at the same vertex) over every 
single vertex in V. These self-loops serve to avoid singularities 
associated with the presence of isolated nodes in Qk (n,p) (for 
which di = 0, and Dk is not invertible). 

B. Variance of Consensus Value 

In this section, we derive an explicit expression for the 
variance of the limiting consensus value for a switching 
directed random graph. We base our analysis in studying the 
terms in ©, i.e., vi (EW k ) and vi (E [W k ® Wk])- In order 
to compute vi (EWjt), we first compute the expectation of 
each entry in Wk- The expectation of the diagonal entries of 
Wk are equal to E [1/ (di + 1)], where di is a random variable 
representing the degree of the i-th node. In a random ER graph 
with probability of link p (and complement q = 1 — p), the 
probability density of di is a Bernoulli distribution with n — 1 
trials and parameter p, i.e., / (di) ~ Ber (n — l,p). Hence, 



Ewj, 



1 



n-l 

^ ~k 

k=0 



1 



n—1 
k 



p k q 



n—k—1 



np 



fi (P, n) 



(4) 



where we have defined fx for future convenience. Furthermore, 
the off-diagonal elements of EWk are equal to 



Ewi 



E 





= E 




1 


a%j = 1 


Ai + l. 
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h + 1 



P(<H 



1 



where we have applied the law of total expectation in the last 
equality. Moreover, it is straightforward to show that f(di — 
l|<2jj = 1) ~ Ber(n — 2,p); thus, 



Ewij = 



P 



-2 

^ k 

k=0 



1 



2 

np — 1 



np (n — 1 ) 



1 - fi (P, n) 
n-l 



(5) 



Taking (01 and (O into account, we can write EWk as follows: 



EV^fc = Ewijlnli + (Ewi, 



1 - /i (p, n) 



1 1 T - 



Ewij)I n 

1 - n fx (p, n) 



In- 



n — l 

It is easy to verify that EWk is irreducible. Therefore, as 
discussed in the previous section, consensus algorithms over 
i.i.d. directed Erdos-Renyi random graph process converge to 
consensus with probability one. Moreover, it is straightfor- 
ward to show that vector 1„ satisfies the eigenvalue equation 
I// EW k = l, r : thus, 

Vl (EW k ) = (6) 
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Therefore, as expected, the mean of the random consensus 
value is equal to the average of x (0), i.e., 



n 

Ex* = - V Xi (0) = x (0) . 

77. — ' 



(7) 



i=l 



The other term in the expression of variance that we need to 
compute is vi (E [Wk <S> Wk])- In order to compute this vector, 
we first compute the entries of matrix E [Wk <S> Wk], which are 
of the form E(wijW rs ), with i, j, r and s ranging from 1 to n. 
The entries can be classified into six different cases depending 
on the relations between the indices. Below, we present the 
expressions for each case. Some of the expressions are in terms 
of the hypergeometric function 3^2(1, 1,1— n;2,2;f>/(p— 1)), 
which for convenience we denote by H(p,n), defined as the 
power series 



H(p, n) 



n-l 



1 



1) 



n-l 
k 



P 



1-p 



In the following expressions we assume that all four indices 
i,j, r and s are distinct. Detailed computations are provided 
in the Appendix. 



Qi 
Q 3 



Qe 



E(wl l )=q n - 1 H(p,n), 
E(wuWjj) = fi(p,n), 
E(wiiW is ) = E(w ij w ii ) = E(w^) 
h(p 1 n)-q n - 1 H{p,n) 
n — 1 

E(w ri w„) = E(w rl w rs ) = fi(p,n) 



1 - fi(p,n) 
n-l 



= E(w ij w ls ) = 



l + 2q n - 1 H{p 1 n)-ih{p,n) 



13 ls ' (n-l)(n-2) 
E(wijWji) = E(wijWj s ) = E(wijW ri ) 



E(WijW r j) = E(w i3 w rs ) 



1 - h(p,n) 
n - 1 



As stated earlier, every entry of E[Wk <E> Wk] is equal to 
one of the expressions provided in ®. The key observation 
is the pattern that such classification of entries induces in the 
matrix. In order to clarify this point, we illustrate this pattern 
for n — 3, where the numbers in parenthesis correspond to 
one of the six cases identified above. As the figure suggests, 
the entries of E[Wfc®W / fe] are identical to the entries of K ®K 
except for those at the rows 1 + r(n + 1) for r = 0, n — 1, 
where matrix K G M. nxn is defined as 



K 



1 - flip, n) 



1 



1 1 T 



nfi(p,n) - 1 



1 



I, 



with fi(p, n) as its diagonal, and [1 — fi(p, n)]/(n — 1) as its 
off-diagonal entries. In Fig. 1, the entries of E[Wk <8> Wk] that 
are different from the entries of K ® K are marked with bold 
lines. 

We now exploit the identified pattern to explicitly compute 
the left eigenvector vi(E[Wfc <8> Wk])- 
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Fig. 1. The pattern of EfWfc (g) Wk] for n = 3. The numbers in parentheses 
represent the value of each entry in terms of expressions Ql to Q6 defined 
in (8). The entries that are different from the corresponding entries of K £5 K 
are marked with bold lines. 



Lemma 1: The left eigenvector of E [Wk S) Wk] corre- 
sponding to its unit eigenvalue is given by 



(8) Mnw k ®Wk] 



PQ-T 



a 



1 ej) 



where p and S depend on p and n as follows: 

p(n — 1) 



pip, n) 
8(p, n) 



p(n - 2) + 1 - (1 - p)' 
n + n(n — l)p(p, n). 



(9) 

(10) 
(ID 



Proof: First of all, notice that E[Wk <£> Wfc] is a stochastic 
matrix whose entries are all strictly positive for p > 0. 
Therefore, it has a unique left eigenvector corresponding to its 
unit eigenvalue, which means that vi(E[W/- <g> Wk]) is well- 
defined. We now show that the pattern of this left eigenvector 
is of the form 



= a(l„®l„) + (/3- a) ^(e, ® e 



(12) 



for some positive numbers a and (3. Notice that all entries 
of this vector are equal to a, except for the ones indexed 
1 + r(n + 1) for r = 0, n — 1, which are equal to j3. To 
show that the eigenvector we are looking for is indeed of the 
given pattern, we premultiply E[Wk ® Wk] by v, and verify 
that 



w T E[Wk®W k ] =a'(l® l) T + (/3'-a , )£(e*«>e. i ) T . (13) 

i=i 

where a' and f3' are positive numbers, given by 

(14) 



'of 




A 


B 




a 


p. 




C 


D 




A 
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with coefficients A, B, C, and D defined as 

1 - fi(p,n) 



and therefore, 



A = l + [n/i(p,n) + n-2] 
1 - hip, n ) 



B 

n - 1 

C = [nhip,n)+n-2] 
D = hip,n) 



(n-1) 2 
1 - flip, n) 



Equation ( fT3l l suggests that the pattern of Vi is preserved when 
it is multiplied by K[Wk ® Wfe]. Therefore, the vector defined 
in ( fT2l i is the unique left eigenvector of the matrix if there are 
positive numbers a = a' and (3 — [3' that satisfy ( TBI ). 

Due to the fact BC = (1-A)(1— D), the matrix in (O has 
an eigenvalue equal to one, with eigenvector [B 1 — A] , 
implying that such (a, (3, a', (3 r ) exist. Thus, the proposed 
vector in ( fT2l i is an eigenvector of E,[W k ® W k ] as long as 
a = (3B/ (1 — A) = p(p, n)/3, which means that 



Vl (E[W k ^W k }) = - 



p(l n ®l n ) + (1 - p) E(e* <g> ei) 



Note that 6(p,n), defined in ( fTTT i. is a normalizing factor 
guaranteeing that the elements of the vector sum up to one. 

■ 

Now that we have derived explicit expressions for the 
eigenvectors (O and (O, we can compute a closed-form 
expression for the variance of the limiting consensus value 
in terms of p and n. 

Theorem 2: The variance of the asymptotic consensus value 
x* of the distributed update defined in (l} over switching 
Erdos-Renyi random graphs with parameter p is given by 



var(x*) 



1-P 



5>i(0)-z(0)] s 



(15) 



where jo(p, n) and <5(p, n) are defined in (TTOb and ( fTTT i, 
respectively. 

Proof: First, from ©, we have that 

2 



[x(0) r Vl (E^)]' 



On the other hand, from (|9), we have that 



[x(0) ® x(0)]' Vl (E[W k <S> W fc ]) = 

n 

p(l„<g>l„) + (l-p)^(ei 

i=l 

[x(0) T l„] 



i[x(0)®x(0)] T 



1 

+ i T f E ([x(0) T e,] ® [x(0) a 



where we have used the fact that (A®B)(C®D) = AC®BD. 
Since the Kronecker terms in the last expression are scalars, 
we have 



[x(0)®x(0)] T Vl (E[W^W^]) = ^n 2 x(0) 2 

o 



1 



P 



var(x*) = (^n 2 - l) [x(0)] 2 + E^W] 2 " 

By adding and subtracting (0)] 2 , the expression for 

the variance can be rewritten as 



var a; 



n(n-l)p + n-<5 
o 

1 — " 

+^E(^(°)- i (°)) 2 ' 



Since 5 = n + n(n — l)p, as defined in (fTTT i. the first term in 
the right-hand-side of the above expression is equal to zero. 
This proves the theorem. ■ 
Expression ( TT3T > shows that, given the parameters of the 
random graph process p and n, the variance of the limiting 
consensus value, x*, is equal to the empirical variance of the 
initial conditions multiplied by the factor n(l — p)/8, which 
only depends on parameters p and n. 



IV. Numerical Simulations 

In this subsection, we present several simulations that il- 
lustrate the result in Theorem [2] In our first simulation, we 
compare the analytical expression for the variance in (TT31 > 
with the empirical variance obtained from 100 realizations of 
the random consensus algorithm for n in a certain range. In 
our simulations, we compute the (analytical and empirical) 
variances for a range of network sizes while keeping the 
expected out-degree of the random graphs fixed to a constant 
value c (i.e., the probability communication in the random 
graphs is then p — c/n, for all n). In Fig. 1, we plot both the 
analytical and empirical variances when the network sizes n 
goes from 5 to 50 nodes and the expected degree is fixed to 
be c = 5, for all n. The initial conditions for each network 
size is given by xi (0) = i/n, for i = 1, ...,n. 



Several comments are in order about the behavior of 
var (a;*) in Fig. 1. First, for n = c = 5, we have that 
p = c/n = 1 (every link exist); hence, the random graph 
is not random, but a complete graph K n , and the distributed 
consensus algorithm converges to the average of the initial 
conditions with zero variance (as one can check in Fig. 1). 
Second, when n is slightly over c, the variance increases quite 
abruptly with n until it reaches a maximum value. For c = 5, 
this maximum is achieved for a network size of 9 nodes. The 
location of this interesting point, that we denote by n (c), can 
be easily computed using Theorem 12 Furthermore, for n > 
n(c) the variance slowly decreases with the network size. One 
can prove that this variance tends asymptotically to zero as 
n — > oo at a rate 1 jn. 

Furthermore, according to < fT~5b . given a vector of x (0) 
initial condition, the variance of the asymptotic consensus 
value is equal to the empirical variance of the entries of x (0) 
rescaled by the factor n (1 — p) /S (where p and S depend on 
the random graph parameters p and n). In Fig. 2, we plot the 
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Fig. 2. Comparison between the empirical variance and the analytical 
variance for n in the interval [5:50] and p = 5/n for all n. 



While different aspects of consensus algorithms over random 
switching networks, such as conditions for convergence and 
the speed of convergence, have been widely studied, a charac- 
terization of the distribution of the asymptotic consensus for 
general asymmetric random consensus algorithms remains an 
open problem. 

In this paper, we have derived closed-form expressions for 
the expectation and variance of the asymptotic consensus value 
as functions of the number of nodes n and the probability of 
existence of a communication link, p. While the expectation 
of the distribution of the consensus value is simply the mean 
of the initial conditions over the nodes of the network, the 
variance presents an interesting structure. In particular, the 
variance of this limiting distribution of the consensus value is 
equal to the empirical variance of the set of initial conditions 
multiplied by a factor that depends on p and n. We have 
derived an explicit expression for this factor and check its 
validity with numerical simulations. 



x10" 




Fig. 3. Several analytical variance for c G {5, 6, 7, 8, 9, 10}. 



values of the factor n (1 — p) /6 for a set of expected degrees 
c e {5, 6, 7, 8, 9, 10} while the network size n varies from 5 
to 70. We observe that the behavior of the factor n (1 — p) /S 
is similar for any given c. Again, for n = c the variances are 
zero and the variances grow abruptly until a maximum, ii (c), 
is reached. For large values of n, the variance slowly decays 
towards zero at a rate 1/n for all c. 



Appendix 
Kronecker Matrix Entries 

The Appendix contains the detailed computation of the 
entries of matrices EWk and E[Wk <X> Wk]- We start by 
computing the elements of E Wk ■ The diagonal entries of EWfc 
are given by: 



Ewu = E 



1 



* i 

k=0 

hip, n) 



k=0 

1 — n n 
1 1 A 



np 



On the other hand, the non-diagonal entries of EWk result in: 

Ew, 



[1 - EWn\ - 



71—1 



np(n — 1) 



n- 1 



We now turn to the computation of the elements of E[Wk ® 
Wk], which are of the form E(wy w rs ). In what follows we 
assume that the indices i, j, r, and s are distinct. We first start 
with elements with in the diagonal subblocks of E[Wk ® Wk]- 



V. Conclusions and Future Work 

We have studied the asymptotic properties of the consensus 
value in distributed consensus algorithms over switching, di- 
rected random graphs. Due to the connectivity of the expected 
graph, consensus algorithms over Erdos-Renyi random graphs 
result in asymptotic agreement. However, the asymptotic value 
of consensus is not guaranteed to be the average of the initial 
conditions. Instead, agents will asymptotically agree on some 
random value in the convex hull of the initial conditions. 




For the rest of entries in the diagonal blocks, it is useful to 
note that Ewu — fi(p,n) and Etoy = 1 ~{^^' n \ as proved 
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in Subsection IIII-BI 

E(wuWrr) = Ewu Ew rr = fl(p,n) 



E(wuW ri ) 

E(wuw rs ) 
E(w li w is ) 



Ew u Ew ri = fi (p, n) 
Ewu Ew rs = fi (p, n) 



1 - flip, n) 
n — 1 

1 - flip, n) 



n-1 

Ew H ~ Ewl hip, n) - q^Hip, n) 



n — 1 



n-1 



Similarly, we have the following results for the off-diagonal 
subblocks: 



E(wijWji) 



HO 



Eiw tj w. ls ) 



Ewij Evjji 



1 - flip, n) 



E(wijWj s ) = Ew i3 Evjjs 

E(lVijW r i) = Ewij Ew r i 

EilVijW r j) = ElVij Ew r j 

%,jWrs) = Ew i3 Ew rs 

E(wijWa) = E{wuWi a ) = 





n — 1 


1 


- fiip,n) 




n — 1 


1 


- hiP,n) 




n — 1 




- hiP, n) 




n-1 


1 


- hip, n) 



E 



idi + l) 2 

E(wnWij) = 



n-1 

hjp^-q^Hjp.n) 
n-1 

E 



idi + 1) 2 _ 
/ 1 (p,n)- (J "- 1 i/(p,n) 



n — 1 



Ew^ - Ewfj - E(wijWu) 
n-2 

l + 2g"- 1 g(p,n)-3/ 1 (p,n) 
(n-l)(n-2) 
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